Bioinformatic processing systems and methods

ABSTRACT

The present disclosure relates to systems and methods for facilitating trusted handling of genomic and/or other bioinformatic information. Certain embodiments may facilitate policy-based governance of access to and/or use of bioinformatic information, improved interaction with and/or use of distributed bioinformatic information, parallelization of various processes involving bioinformatic information, and/or reduced user involvement in bioinformatic workflow processes, and/or the like. Further embodiments may provide for memoization processes that may persistently store final and/or intermediate results of computations performed using genomic data for use in connection with future computations.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/260,714, filed Apr. 24, 2014, which claims the benefit of priorityunder 35 U.S.C. § 119(e) to U.S. Provisional Patent Application No.61/815,702, filed Apr. 24, 2013, and entitled “BIOINFORMATIC PROCESSINGSYSTEMS AND METHODS”, both of which are hereby incorporated by referencein their entireties.

COPYRIGHT AUTHORIZATION

Portions of the disclosure of this patent document may contain materialwhich is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentor the patent disclosure, as it appears in the U.S. Patent and TrademarkOffice patent file or records, but otherwise reserves all copyrightrights whatsoever.

SUMMARY

The present disclosure relates generally to systems and methods forfacilitating trusted handling of genomic and/or other bioinformaticinformation. More specifically, but not exclusively, the presentdisclosure relates to systems and methods for enabling secure, governed,and/or audited use of genomic and/or bioinformatic information.

Genetic testing is moving from detection of Single NucleotidePolymorphisms (“SNPs”)—isolated individual chemical differences ingenetic code—to Whole Genomic Sequencing (“WGS”), which records everybase pair in a genetic sequence. Genomic sequencing information may beused in connection with a variety of applications including, forexample, molecular and evolutionary biology studies. For example, inmolecular biology studies, genomic information may be used in connectionwith identifying new genes, identifying potential drug targets,identifying genetic associations with certain diseases and/orconditions, and/or the like.

Bioinformatics workflows, including workflows involving genomicinformation, may involve a series of manually assembled and/or performedserial/sequential steps. For example, in a connection with abioinformatic workflow process, a researcher may download gigabytes ofgenomic data included in unaligned data files from a public and/orprivate repository (e.g., using file transfer protocol (“FTP”) or thelike). The unaligned data may, for example, be processed by avendor-provided tool and/or a special purpose program or script.

Aligned output files may be processed and/or analyzed by a “variantcaller” (e.g., a Java language variant caller) to identify locations ofgenetically interesting features in each of the aligned output files. Aset of subjects (e.g., a cohort) from a database or other collection ofmedical information may be selected. Aligned output files associatedwith each subject in the cohort may be processed and/or analyzed toidentify particular mutations or other features of interest. Outputinformation from this processing/analysis may be collected andstatistically analyzed in connection with the researcher's studies.

The above-described exemplary workflow may introduce several potentialproblems, including, for example:

Lack of Data Governance—The above-described workflow may assume thatresearchers have the right to access genomic data of interest (e.g.,data included in unaligned data files from a public and/or privaterepository). In some instances, however, individuals, organizations,and/or governmental authorities may place certain restrictions on theaccess and/or use of genomic data. For example, certain jurisdictionsmay have laws governing the distribution of genomic data to outside thejurisdiction.

Similarly, the above-described workflow may lack auditing and/ormanagement capabilities governing access to and/or use of genomic data.For example, after the initial download of genomic data, a researcher'sactivities in connection with the use and/or distribution of the datamay not be readily ascertained and/or tracked. In view of theselimitations, the above-described exemplary workflow may not bewell-suited for use in connection with genomic data that has certainassociated access and/or use restrictions.

Centralized Information—The above-described workflow involvesdownloading genomic data to a centralized location for processing andanalysis (e.g., downloaded from one or more public and/or privaterepositories). Such a data centralization process may requiresignificant resources, and may not be particularly practical whengenomic data is distributed across multiple databases. Moreover, asdiscussed above, certain genomic data may be associated with ajurisdiction that does not allow distribution of the data from thejurisdiction. Accordingly, centralized gathering of genomic data thatincludes data from a restrictive jurisdiction may need to be performedwithin that jurisdiction.

Sequential Workflow—As discussed above, the various constituent steps ofthe exemplary workflow may be performed sequentially and/or serially bya centralized computing system. Such sequential and/or serial processingand/or analysis may require significant computing resources by thecentralized system performing the activities.

User Involvement—Many constituent processes in the above-describedworkflow involve direct user interaction. For example, a user may beinvolved in selecting genomic data to download to a centralizedprocessing location. Direct user involvement in connection with theworkflow may consume time and/or other resources of a researcher thatcould otherwise be spent on more productive activities.

Systems and methods are described herein that ameliorate some or all ofthese potential problems. For example, in certain embodiments, thedisclosed systems and methods can be used to enable secure and/orpolicy-based access to and/or use of bioinformatic informationincluding, without limitation, genomic information. Among other things,the disclosed systems and methods may facilitate policy-based governanceof access to and/or use of bioinformatic information (e.g.,distribution, analysis, etc.), improved interaction with and/or use ofdistributed bioinformatic information, parallelization of variousprocesses involving bioinformatic information, reduced user involvementin bioinformatic workflow processes, and/or the like.

In certain embodiments, the disclosed systems and methods may usestructured workflow specifications and/or syntaxes for defining certainprocesses involving bioinformatic information. Such specificationsand/or syntaxes may facilitate a variety of activities including, forexample, genomic data and/or cohort selection, target variant selectionin connection with research and/or other activities utilizingbioinformatic information, parallelization of various bioinformaticprocessing and/or analysis functions, protection of certain personalinformation relating to individuals associated with bioinformaticinformation (e.g., personally identifiable information (“PII”)), and/orthe like. In some embodiments, the disclosed specification and/or syntaxstructure may enable a user to specify and/or implement variousbioinformatic information workflows and/or processes in connection withone or more associated computer systems.

In further embodiments, the disclosed systems and methods may enablepersistent storage of results of computations and/or analyses performedusing various bioinformatic information. In certain embodiments, finaland/or intermediate results of computations performed usingbioinformatic information may be persistently stored for use inconnection with future computations using a memoization process. Incertain embodiments, utilizing prior and/or intermediate computationalresults in connection with new computations may provide certainprocessing efficiencies and/or improvements in computational speeds.

BRIEF DESCRIPTION OF THE DRAWINGS

The inventive body of work will be readily understood by referring tothe following detailed description in conjunction with the accompanyingdrawings, in which:

FIG. 1 illustrates an exemplary ecosystem for storage, management, andprocessing of genomic data consistent with embodiments of the presentdisclosure.

FIG. 2 illustrates an exemplary workflow process for interacting withgenomic data consistent with embodiments of the present disclosure.

FIG. 3 illustrates an exemplary workflow specification consistent withembodiments of the present disclosure.

FIG. 4 illustrates an exemplary result of instantiating and running aspecification consistent with embodiments of the present disclosure.

FIG. 5 illustrates an example of sharing authentication credentialsacross multiple modules consistent with embodiments of the presentdisclosure.

FIG. 6 illustrates an exemplary syntax for specifying a domainconsistent with embodiments of the present disclosure.

FIG. 7 illustrates an example of specification of a domain consistentwith embodiments of the present disclosure.

FIG. 8 illustrates an exemplary workflow process for identifying certainvariants in genomic data consistent with embodiments of the presentdisclosure.

FIG. 9 illustrates a conceptual diagram of a variant identificationprogram consistent with embodiments of the present disclosure.

FIG. 10 illustrates an exemplary workflow specification including areferentially transparent type specification consistent with embodimentsof the present disclosure.

FIG. 11 illustrates a conceptual diagram of a computation having twoinputs and one output consistent with embodiments of the presentdisclosure.

FIG. 12 illustrates a conceptual diagram of a computation including amemoization module consistent with embodiments of the present disclosure

FIG. 13 illustrates a conceptual diagram of a computation including aplurality of constituent computations implementing memoization processesconsistent with embodiments of the present disclosure

FIG. 14 illustrates another conceptual diagram of a computationincluding a plurality of constituent computations implementingmemoization processes consistent with embodiments of the presentdisclosure.

FIG. 15 illustrates a conceptual diagram of a computation implementingpolicy-driven memoization processes consistent with embodiments of thepresent disclosure.

FIG. 16 illustrates a conceptual diagram of another computationimplementing policy-driven memoization processes consistent withembodiments of the present disclosure.

FIG. 17 illustrates an exemplary system that may be used to implementembodiments of the systems and methods of the present disclosure.

DETAILED DESCRIPTION

A detailed description of systems and methods consistent withembodiments of the present disclosure is provided below. While severalembodiments are described, it should be understood that the disclosureis not limited to any one embodiment, but instead encompasses numerousalternatives, modifications, and equivalents. In addition, whilenumerous specific details are set forth in the following description inorder to provide a thorough understanding of the embodiments disclosedherein, some embodiments can be practiced without some or all of thesedetails. Moreover, for the purpose of clarity, certain technicalmaterial that is known in the related art has not been described indetail in order to avoid unnecessarily obscuring the disclosure.

The embodiments of the disclosure may be understood by reference to thedrawings, wherein like parts may be designated by like numerals. Thecomponents of the disclosed embodiments, as generally described andillustrated in the figures herein, could be arranged and designed in awide variety of different configurations. Thus, the following detaileddescription of the embodiments of the systems and methods of thedisclosure is not intended to limit the scope of the disclosure, asclaimed, but is merely representative of possible embodiments of thedisclosure. In addition, the steps of any method disclosed herein do notnecessarily need to be executed in any specific order, or evensequentially, nor need the steps be executed only once, unless otherwisespecified.

Systems and methods are presented that facilitate secure, governed,and/or audited use of genomic and/or bioinformatic information. Incertain embodiments, the disclosed systems and methods can be used toenable policy-based governance of access to and/or use of genomic data,improve interaction with and/or use of distributed genomic data,facilitate parallelization of processes involving genomic data, reduceuser involvement in genomic data workflow processes, and/or the like. Insome embodiments, the disclosed systems and methods may use structuredworkflow specifications and/or syntaxes for defining certain processesinvolving genomic data. In further embodiments, the disclosed systemsand methods may provide for memoization processes that enable certainresults of computations based on genomic data to be retained and used inconnection with future computations. It will be appreciated that thesesystems and methods are novel, as are many of the components, systems,and methods employed therein.

In certain embodiments, the systems and methods described herein can,for example, be used in connection with digital rights management(“DRM”) technologies such as those described in commonly assigned U.S.patent application Ser. No. 11/583,693, entitled “Digital RightsManagement Engine Systems and Methods,” and filed Oct. 18, 2006 (“the'693 application”), service orchestration and DRM technologies such asthose described in commonly assigned U.S. Pat. No. 8,234,387, entitled“Interoperable Systems and Methods for Peer-to-Peer ServiceOrchestration”, and filed Jun. 7, 2004 (“the '387 patent”), informationgovernance technologies such as those described in commonly assignedU.S. patent application Ser. No. 13/444,624, entitled “InformationSecurity Systems and Methods”, filed Apr. 11, 2012 (“the '624application”), and/or information processing technologies such as thosedescribed in commonly assigned U.S. patent application Ser. No.13/654,349, entitled “Systems and Methods for Protecting and GoverningGenomic and Other Information”, filed Oct. 17, 2012 (“the '349application”) (the contents of '693 application, the '387 patent, the'624 application, and the '349 application hereby being incorporated byreference in their entireties), as well as in other contexts.

Genomic Data Processing Ecosystem

FIG. 1 illustrates an exemplary ecosystem for storage, management, andprocessing of genomic data 104-108 consistent with embodiments of thepresent disclosure. As used herein, the terms “genomic data” and/or“genomic information” may generally refer to data expressing,representing, and/or derived from the entirety or a portion of a genomeor genome sequence. This data may include, without limitation,information encoded in chemical structures such as DNA, mRNA, andproteins as well as related regulatory information such as methylationstatus. As used herein the term “genome” may refer to an organism'shereditary information. A genome may be encoded in DNA or RNA, and maybe represented as mRNA or as protein sequences derived from thesenucleic acid sequences. The term “genome” may include both genes andnon-coding sequences. When applied to a specific organism, the term“genome” can refer to genomic data from normal cells—includingmitochondrial DNA—and also genomic data from related cells such astumors and other organisms of the microbiome. Although embodiments ofthe disclosed systems and methods are discussed herein in connectionwith genomic data, it will be appreciated that the disclosed systems andmethods may also be used in connection with any other suitableinformation, including, for example, any other type of bioinformaticinformation.

A client system 100 may provide a variety of functions allowing a userto process, analyze, and/or otherwise interact with genomic data104-108. In certain embodiments, the client system 100 may becommunicatively coupled with one or more genomic data storage and/orprocessing systems 110-114 via one or more networks 102. The one or moregenomic data storage and/or processing systems 110-114 may, among otherthings, be configured to store and/or manage genomic data 104-108 and/orinteract with the client system 100 in connection with the same. Incertain embodiments, the client system 100 may be associated with aservice and/or an application or process that may access and/orotherwise remotely use information stored by the one or more genomicdata storage and/or processing systems 110-114 to perform variousoperations thereon. For example, an application executing on the clientsystem 100 may enable a user of the system to interact with one or moregenomic data storage and/or processing systems 110-114 in connectionwith performing various workflow processes and/or analyses using thegenomic data 104-108 consistent with embodiments disclosed herein.

The one or more networks 102 may comprise a variety of networkcommunication devices and/or channels and may use any suitablecommunication protocols and/or standards facilitating communicationbetween the client system 100, the genomic data storage and/orprocessing systems 110-114, and/or one or more other systems. Network102 may comprise the Internet, a local area network, a virtual privatenetwork, and/or any other communication network utilizing one or moreelectronic communication technologies and/or standards (e.g., Ethernetor the like). In some embodiments, the network 102 may comprise awireless carrier system, such as a personal communications system(“PCS”), and/or any other suitable communication system incorporatingany suitable communication standards and/or protocols. In furtherembodiments, the network 102 may comprise an analog mobilecommunications network and/or a digital mobile communications networkutilizing, for example, code division multiple access (“CDMA”), GlobalSystem for Mobile Communications or Groupe Speciale Mobile (“GSM”),frequency division multiple access (“FDMA”), and/or time divisionalmultiple access (“TDMA”) standards. In certain embodiments, the network102 may incorporate one or more satellite communication links. In yetfurther embodiments, the network 102 may use IEEE's 802.11 standards,Bluetooth®, ultra-wide band (“UWB”), Zigbee®, and/or any other suitablecommunications technology or technologies.

The client system 100 and/or the genomic data storage and/or processingsystems 110-114 may comprise a variety of computing devices and/orsystems, including any computing system or systems suitable to implementthe systems and methods disclosed herein. Systems 100, 110-114 may, forexample, comprise a variety of computing devices and systems, includingwithout limitation laptop computer systems, desktop computer systems,sever computer systems, distributed computer systems, smartphones,tablets, and/or the like. It will be appreciated that any suitableconfiguration of computing systems and storage media could be used inconnection with the connected systems 100, 110-114, including withoutlimitation, a single server or duster of servers, or a distributedcollection of heterogeneous computer systems connected by a variety ofnetworks (e.g., such as the Internet, public and/or private networks,and/or the like).

In certain embodiments, the client system 100 and/or the genomic datastorage and/or processing systems 110-114 may comprise at least oneprocessor system configured to execute instructions stored on anassociated non-transitory computer-readable storage medium. As discussedin more detail below, the client system 100 and/or the genomic datastorage and/or processing systems 110-114 may further comprise a secureprocessing unit (“SPU”) configured to perform aspects of sensitiveoperations such as trusted credential and/or key management, securepolicy management, and/or other aspects of the systems and methodsdisclosed herein. The client system 100 and/or the genomic data storageand/or processing systems 110-114 may further comprise software and/orhardware configured to enable electronic communication of informationbetween the devices and/or systems 100, 110-114 via the network 102using any suitable communication technology and/or standard.

The genomic data storage and/or processing systems 110-114 may beconfigured to store, manage, process, distribute, and/or update certaingenomic data 104-108 stored thereon. In certain embodiments, the genomicdata storage and/or processing systems 110-114 may be associated withone or more processing domains, jurisdictions, organizations,institutions, users, locations and/or the like. As an example, genomicdata storage and/or processing system 110 and associated genomic data104 may, for example, be associated with a research institution, genomicdata storage and/or processing system 112 and associated genomic data106 may, for example, be associated with a jurisdiction that does notallow distribution of genomic data 106 from the jurisdiction, andgenomic data storage and/or processing system 114 and associated genomicdata 108 may, for example, be associated with a business organizationoffering genomic data 108 as a data product for research purposes. Incertain embodiments, the genomic data storage and/or processing systems110-114 may be associated with one or more cloud-based systems for thetrusted storage and analysis of genetic and/or other information, andmay incorporate embodiments of the systems and methods disclosed inconnection with the '349 application.

As discussed above, an application executing on the client system 100may enable a user of the system to interact with the one or more genomicdata storage and/or processing systems 110-114 in connection withperforming various workflow processes and/or analyses using the genomicdata 104-108. In certain embodiments, the client system 100 may beconfigured to issue certain requests/queries to the genomic data storageand/or processing systems 110-114 directing the genomic data storageand/or processing systems 110-114 to perform certain processes and/oroperations using genomic data 104-108 stored thereon. Results of theprocesses and/or operations may be returned to the client system 100from the associated genomic data storage and/or processing systems110-114. In certain embodiments, such results may obfuscate, anonymize,and/or otherwise filter PII and/or other phenotypical data associatedwith the genomic data 104-108, such that a user of the client system 100may not ascertain and/or readily ascertain PII from results derived fromthe genomic data 104-108.

In some embodiments, the one or more genomic data storage and/orprocessing systems 110-114 may include varying levels of hardware and/orsoftware security hardening based on the security of the genomic data104-108 stored thereon. For example, genomic data 104-108 that does notinclude information associating particular genetic sequences withidentification information regarding associated individuals (e.g.,names, addresses, Social Security numbers, etc.) may be protected by aless security-hardened system than genomic data 104-108 that includessuch associations.

In certain embodiments, prior to interacting with genomic data 104-108managed by the one or more genomic data storage and/or processingsystems 110-114, the client system 100 and/or a user thereof mayauthenticate their identity and/or rights to access and/or otherwise usethe genomic data 104-108. For example, username and/or passwordauthentication, biometric authentication, personal identification numberauthentication, and/or any other suitable type of user authenticationmay be used in connection with authentication of the rights of theclient system 100 and/or a user thereof to access and/or use the genomicdata 104-108.

The one or more genomic data storage and/or processing systems 110-114and/or the client system 100 may be configured to enforce privacy and/orpolicies associated with the genomic data 104-108 specified bystakeholders in the data (e.g., associated individuals, institutionsthat gathered the data, governmental authorities responsible forenforcing certain jurisdictional restrictions on the access ordistribution of the data, etc.). The policies may articulate certainrestrictions, conditions, requirements, and/or other actions associatedwith the access, use, distribution, and/or the like of the genomic data104-108. Such policies may be enforced in connection with access, use,distribution, and/or the like of the genomic data 104-108 by the clientsystem 100 and/or a user thereof. For example, a policy may articulatethat only users authenticating their possession of certain accesscredentials may use certain genomic data 104-108 managed by the one ormore genomic data storage and/or processing systems 110-114 and/orderive certain computational results therefrom. Policies may articulate,without limitation, policies preventing and/or otherwise restricting theaccess, use, and/or distribution of genomic data 104-108, policiesarticulating that certain security requirements be met prior to access,use, and/or distribution of genomic data 104-108, policies articulatingthat certain actions be performed in connection with the access, use,and/or distribution of genomic data 104-108, and/or the like. A varietyof other types of policies may be associated with genomic data 104-108,and any type of policy articulating any restrictions, conditions,requirements, and/or actions to be enforced in connection with theaccess, use, and/or distribution of the genomic data 104-108 may be usedin connection with the disclosed embodiments. In some embodiments, suchpolicies are expressed and enforced using digital rights managementtechnologies such as those described in the '693 application and/or the'387 patent, previously incorporated by reference herein, although itwill be appreciated that any suitable policy expression and enforcementtechnologies could be used.

It will be appreciated that a number of variations can be made to thearchitecture and relationships presented in connection with FIG. 1within the scope of the inventive body of work. For example, withoutlimitation, in some embodiments, some or all of the functions performedby the client system 100 may be performed by the one or more genomicdata storage and/or processing systems 110-114. Similarly, some or allof the functions performed by the one or more genomic data storageand/or processing systems 110-114 may be performed by the client system100. Thus it will be appreciated that FIG. 1 is provided for purposes ofillustration and explanation, and not limitation.

Genomic Information Workflow Overview

FIG. 2 illustrates an exemplary workflow process 200 for interactingwith genomic data consistent with embodiments of the present disclosure.For example, the illustrated workflow process 200 may be used inconnection with identifying a prevalence of a particular variant withina population. In certain embodiments, a workflow process involvinggenomic data may, at a high level, be specified by a query having aparticular syntax. For example, the syntax may express a group ofindividuals to which a user is permitted access and/or use of associatedgenomic data, a particular trait and/or condition associated with apopulation of interest, and a targeted variant of interest.

As an example, an example specification of a workflow process may beexpressed according to the following:

U|pancreatic cancer|% KRAS variant 4

In the above example, the specification may be interpreted as the beingassociated with the following workflow process: (1) start with auniverse of U individuals to which a user has permission to accessassociated genomic data (e.g., as articulated by enforced policy or thelike), (2) filter the universe of U individuals by selecting individualswith a record of pancreatic cancer and (3) compute a percentage of thoseindividuals that exhibit a particular genetic variant (e.g., a KRASvariant 4).

The above specification may hide certain details regarding an underlyingworkflow process. For example, the specified universe of individuals, U,may represent a set of all genomic data and/or records to which aparticular user has access (e.g., as determined by enforced policy orthe like), a specified subset of such data, and/or the like. This setmay depend on the user, articulated policy associated with thecorresponding genomic data and/or records, and/or the like. In certainembodiments, the set may change dynamically based on an overall contextof a specified workflow process. For example, due to policyrestrictions, the size of the set may increase or decrease depending ona type of operation to be performed on associated genomic dataarticulated by the query specification.

The second step, filtering the universe of U individuals by selecting acohort of individuals with a record of pancreatic cancer, may hidecertain details regarding where associated phenotypical data is located,what types of databases are being used to store the data, and/or thelike. The third step, computing a percentage of the cohort with aparticular genetic variant, may hide even further detail. For example,the location and storage format of the associated genomic data, whichmay be distributed across a plurality of servers, organizations,laboratories, and/or jurisdictions, is not specified by thespecification. Furthermore, the specification may not specify that, incertain instances, genomic data may be analyzed and/or processed inparallel.

In certain embodiments, the above-described exemplary queryspecification may implement the workflow process 200 illustrated in FIG.2 to identify a prevalence of a particular variant within a population.In certain embodiments, the various constituent operations included inthe illustrated workflow process 200 may be performed by one or morefunctional modules 202-216 (e.g., software modules and/or the like)configured to execute on a client system, one or more genomic datastorage and/or processing systems, and/or any other suitable system orcombination thereof.

As shown, a phenotype selection module 202 may select a cohort from aphenotypical database (e.g., a database containing medical recordsand/or other phenotypical information or the like). For example, thephenotype selection module 202 may select a cohort having a particulartrait (e.g., pancreatic cancer) from a set of individuals that a user ofa client system has rights to access associated genomic data.

In certain embodiments, genomic data associated with a selected cohortmay be distributed across multiple genomic data storage and/orprocessing systems (e.g., systems in different jurisdictions, associatedwith different institutions, and/or the like). For example, genomic dataassociated with a selected cohort may be distributed across differentjurisdictions or different institutions, and may not be readilycentralized due to various legal restrictions associated with thejurisdictions or institutions, and/or logistics of a data centralizationprocess (e.g., cost, limited centralized storage capacity, etc.).Accordingly, in certain embodiments, various operations associated withcertain functional modules 204-214 in the workflow process 200 may beperformed by multiple genomic data storage and/or processing systems(e.g., performed in parallel).

In certain embodiments, for each subject in the selected cohort,associated genomic data may be selected, retrieved, extracted and/orotherwise identified by genomic data selection modules 204-208. Incertain embodiments, a selection module of the genomic data selectionmodules 204-208 may extract genomic data stored and/or managed byassociated genomic data storage and/or processing system executing theselection module or in communication therewith. For example, genomicdata selection module 204 may select, retrieve, extract, and/orotherwise identify genomic data associated with a subject of a cohortstored by a first genomic data storage and/or processing system, genomicdata selection module 206 may select, retrieve, extract, and/orotherwise identify genomic data associated with a subject of a cohortstored by a second genomic data storage and/or processing system, and/orthe like. In this manner, genomic data selection modules 204-208 mayoperate on various distributed genomic data stored and/or managed by aplurality of associated genomic data storage and/or processing systems(e.g., operating and/or processing in parallel or the like).

Genomic data selected, retrieved, extracted and/or otherwise identifiedby genomic data selection modules 204-208 may be processed by genomicdata matching modules 210-214 to identify the presence and/or absence ofa particular variant and/or characteristic in the genomic data using anysuitable genomic data analyzing technique. The results of the processingby the genomic data matching modules 210-214 (e.g., whether processedgenomic data for a subject in a selected cohort includes and/or does notinclude a particular variant and/or characteristic of interest) may bepassed to one or more other modules for further processing. For example,in FIG. 2 the results are passed to a counting module 216 that maycompute a percentage and/or number of subjects in the selected cohorthaving genomic data that includes and/or does not include the variantand/or characteristic of interest.

Workflow Instantiation

In certain embodiments, to instantiate the exemplary workflow processdescribed above and illustrated in connection with FIG. 2, a user mayspecify and/or implement a variety of subroutines and/or sub-processes.In certain embodiments, the subroutines and/or sub-processes may notsubstantially change when certain modifications to a query specificationare changed and, accordingly, may be used in connection with a varietyof specified workflow processes. In some embodiments, workflowinstantiation may include, without limitation, some or all of thefollowing activities:

A user may specify a query to be performed in connection with aphenotypical database (e.g., a medical record database or the like). Incertain embodiments, the query may be specified as an SQL statement. Inother embodiments, the query may be specified in another structuredformat and/or in a more unstructured format (e.g., a natural languagespecifications, etc.), and thus it will be appreciated that any suitableformat could be used based, e.g., on what query language or format aparticular database (or databases) supports. In some embodiments, thequery may be distributed across a plurality of databases, and a user maycollate results returned in response to the query from the databases ata client system.

A database query may include credentials that identify a requestinguser. Such credentials may be used in connection with authenticating auser's identity and/or associated rights to access and/or otherwise usegenomic data.

Access to a database including phenotypical and/or genomic data and/oruse of such data may be audited by a genomic data storage and/orprocessing system and/or other database management system and/or by asystem that processes an access request (e.g., a client system and/orthe like). In certain embodiments, such auditing may provide a varietyof information relating to the access to and/or use of phenotypicaland/or genomic data.

A user may implement logic that takes predefined data sets (e.g., eachrow, in some embodiments) returned in response to a database query andforward this data as an individual parameter to a genotyping stage(e.g., genomic data selection and/or matching processes).

A user may implement distribution logic that takes a defined data set(e.g., a row) returned in response to a database query and forwards itas an individual parameter to a genotyping stage (e.g., genomic dataselection and/or matching processes). In certain embodiments, suchdistribution logic may be sensitive to resources available to aparticular user and/or the user's ability and/or rights to commandresources on remote systems.

A user may identify individual systems to which genotyping requests(e.g., requests for genomic data selection and/or matching processes)are made and may send genotyping process requests to the identifiedsystems.

A user may implement methods to ensure that systems having access togenomic data are provisioned with certain versions of software requiredto properly interrogate the genomic data.

A user may map phenotypical identification information associated withindividual subjects that are returned in response to a database query tocorresponding genomic identification information associated with thesubjects' genomic data.

A user may generate and/or initiate a system to generate one or moredatabase queries based on the genomic identification information. A usermay further generate and/or initiate one or more systems to collectvarious results from the database queries, process the results (e.g.,compute associated statistics, identify particular characteristicsand/or variants, etc.), and return the results of the processing to auser.

For various processes including in a workflow, a user may create adapterroutines that ensure that the processes can communicate results tosubsequent processing stages in a manner that modules implementingsubsequent processing stages may understand.

Some or all of the above activities may be streamlined by embodiments ofthe disclosed systems and methods, thereby improving the ability of auser to specify and implement a desired workflow. In certainembodiments, a user may implement a workflow by generating a workflowspecification. FIG. 3 illustrates an exemplary workflow specification300 consistent with embodiments of the present disclosure.

The illustrated workflow specification 300, which may, for example, beembodied as a software file having a .spc extension, may describe adesired workflow. In certain embodiments, the workflow specification 300may specify a way to instantiate functional modules used in connectionwith a workflow from one or more templates and connect those instancestogether. The workflow specification 300 may include, among otherthings, a description of a problem and/or workflow process topologyand/or a set of parameters from individual computational modules used inconnection with the workflow process.

For example, in the illustrated workflow specification 300, under thecomment line “//Topology”, a topology of a workflow process consistentwith the process illustrated in connection with FIG. 2 is specified. Thetopology is specified as including a module named “phenoselect” thatwill send its output (in parallel) to one or more instances of a modulenamed “genoselect.” In the illustrated specification 300, theequal-arrow syntax, “=>”, may specify that the module provided on theright side of the syntax is a module having multiple instances. Thetopology further includes a specification that each instance of the“genoselect” module may send its output to a “genomatch” module on a 1:1basis. In certain embodiments, the colon-arrow syntax, “:>”, may be usedto specify this aspect of the process topology. Finally, the exemplarytopology specifies that each “genomatch” module may send results to aninstance of a “count module”. In certain embodiments, the collection ofmultiple outputs into a single node and/or module may be represented inthe specification 300 by a single-arrow syntax “->”.

Under the comment line “//Template parameters”, each of the functionalmodules named in the topology may be parameterized. In certainembodiments, the topology and template specifications may be presentedin any order in connection with the workflow specification 300 (e.g.,interspersed in the file). The specified parameters may include one ormore named key-value pairs that may determine how software code for aparticular module will be instantiated and/or parameterized.

In some embodiments, a “template” keyword may be used to identify atemplate file, which may be embodied as a software file having a .tplextension. A template file may include template code for creating aninstance of an associated module. In some embodiments, the template mayoperate by keyword substitution. In some embodiments, a keyword forwhich a value is specified in the specification 300 using a substitutionsyntax may be substituted into a corresponding location in a templatefile. For example, for a key-value pair “name: Bob” in the specification300, a template file may specify a command “print “Hello $(name)”. Whenthis template is instantiated, the value “Bob” may be substituted for“$(name)”, resulting in the code “print ‘Hello Bob’”.

In some embodiments, to instantiate a workflow process from aspecification 300 and various template files, a system may compile thespecification 300 into executable or interpretable code that may beexecuted or interpreted on a suitable system. In certain embodiments, asystem that may manage instances of parallel execution, security,auditing, and/or database access processes may be used, such as thesystem described in the '349 application.

FIG. 4 illustrates an exemplary result 400 of instantiating and runninga specification consistent with embodiments of the present disclosure.For example, the exemplary result 400 may be generated by instantiatingthe specification described above in connection with FIG. 3. As shown inFIG. 4, the specification may be executed asynchronously and/or inparallel. The “node#@127.0.0.1” notation may refer to differentcomputational nodes in the system, each of which may manage one or moreprocesses. In the example parameterization generating the illustratedresult 400, ten matches from the “phenomatch” module were found anddistributed across four nodes for computation. In certain embodiments,the computational nodes may be associated with a single system. Infurther embodiments, the computational nodes may be associated with aplurality of distributed systems and/or locations (e.g., different datacenters and/or the like). In some embodiments, the system mayautomatically manage distributing processes that perform computationsacross the various nodes and/or handle communication between variousnodes.

A variety of other syntax elements may be included in a workflowspecification file that may, among other things, allow for creation ofmore advanced workflows. For example, a “like” syntax may allow one typeto extend another, thereby incorporating associated key-value pairs.This syntax allows, for example, authentication credentials to be sharedacross multiple modules. FIG. 5 illustrates an example 500 of sharingauthentication credentials across multiple modules consistent withembodiments of the present disclosure.

In the illustrated example 500, when the “genoselect” module isinstantiated, the keys “user”, “authtoken”, and “expires” may besubstituted as if they had been specified in the “genoselect” moduledirectly. In some embodiments, this mechanism may allow common variablesto be shared across multiple modules. In certain embodiments, a type may“like” any number of other types.

In a specification file, various functional modules may be restricted torun in one or more specified domains (e.g., groupings of computingand/or storage resources). In certain embodiments, the aforementionedfunctional modules may be parallelized across a default domain. In otherembodiments, a writer of a specification file may dictate that certaincomputations be assigned to differing sets of resources. In certainembodiments, this functionality may be useful in connection withdirecting a computation to occur in a domain that has access to aspecific resource that the computation requires.

As an example, an institution (e.g., the ABC Institute) in the UnitedKingdom may store genomic data associated with a particular individual,John Smith. The institution may have a data access policy that prohibitsdistribution of raw genomic data associated with John Smith. Using adomain specification in a specification file, a user may direct anoperation on John Smith's genome to be performed within theinstitutions' domain (e.g., on a system associated with the institutionor the like). FIG. 6 illustrates an exemplary syntax 600 for specifyinga domain consistent with embodiments of the present disclosure.

In the illustrated exemplary syntax 600, the “phenoselect” module isspecified as being parallelized over a set of resources specified by thedomain “ABCInstitute”. When a domain is mentioned in a specificationfile, a system may attempt to load a second file named after the domain(e.g., a file having a .dom extension or the like). Accordingly, in theexample syntax 600, the mention of “ABC Institute” may cause the systemto load “ABCInstitute.dom” to specify a set of resources that comprisethe domain.

FIG. 7 illustrates an example 700 of specification of a domainconsistent with embodiments of the present disclosure. The illustratedexample 700 includes a list of endpoints to which computations and/orassociated modules may be assigned. In further embodiments, the list maycontain other domain parameters such as access credentials and/or thelike. In certain embodiments, the specification of domain parameters mayalso be included in connection with a list of endpoints to whichcomputations may be assigned.

In certain instances, a designated domain of a computation may be afunction of a previous computation. In some embodiments, a plus-arrowsyntax, “+>”, may be used to specify that messages passing between twonodes should be inspected and routed to an appropriate domain. Forexample, if a specification file includes a line indicating “x+>y”, theinstance “x” may be assumed to produce tagged outputs of the format“{domain, Msg}”, where “domain” is the computation domain to whichmessages should be routed, and ““Msg” is the message to send to thatdomain.”

In another example of use of a plus-arrow syntax operator, a distributedhash table style lookup module may take desired genomic identificationinformation associated with an individual and return a location forassociated genomic data (e.g., a location expressed in terms of acomputation domain). For example, in such an embodiment, an output forthe associated individual, whose genomic data may be stored by the ABCInstitute in the United Kingdom, may be a tuple of the domain and thegenomic identification information (e.g., “{ABCInstitute,0123456789abcdef}”). The tuple may automatically be routed to the“ABCInstitute” domain. Another tuple (e.g., “{ebi, c0dec0dec0dec0de}”),may be routed to the “ebi” domain.

Genetic Variant Carrier Identification

FIG. 8 illustrates an exemplary workflow process for identifying certainvariants in genomic data consistent with embodiments of the presentdisclosure. Particularly, in connection with the illustrated workflow, agenetic counseling service 800 may offer a genetic testing servicedesigned to determine whether two individuals are both carriers of aparticular genetic variant. For example, in certain embodiments, such aservice 800 may provide an indication of a probability that theoffspring of the two individuals will be born with a specific geneticdisorder, such as Tay-Sachs Disease. Consistent with embodimentsdisclosed herein, a carrier screening process may receive genomic dataassociated with both individuals, determine whether the individuals area carrier for the disease, and/or determine a likelihood that theindividuals' offspring will be born with the disease of interest. Forpurposes of this illustrative example, if both parents are carriers of aparticular genetic variant, their offspring have a 25% chance of havinga disease and a 50% chance of being a carrier, and if neither of theindividuals are carriers, their offspring have no chance of having thedisease or being a carrier.

In the above simplified example, the screening process may reveal to thegenetic counseling service 800 the carrier status of both patients with100% certainty. In certain instances, however, the individuals may notwish to have this personal information made known to third parties withsuch certainty. Accordingly, in some embodiments, the process may beimplemented in a manner such that personal information, such asindividual carrier status, may not be revealed and/or may otherwise beobfuscated to the genetic counseling service 800 while still allowingthe counseling service 800 to identify situations where individuals aremore likely to have offspring with a particular disease.

In certain embodiments, certain aspects of a carrier screening workflowprocess may operate on genomic data associated with individuals in amanner that is not visible to the service 800. For example, asillustrated, the counseling service 800 may issue a request to a firstprogram 802 implementing a first part of the screening process. Therequest may identify the names (or other identification information) oftwo individuals, Alice and Bob, that the service 800 wishes to analyzeto determine whether their offspring have a risk of developing aparticular disease.

The first program 802 may access phenotypical data 804 associating theidentification information provided with the request with anonymizedgenomic data identification information and identify genomic dataidentification information associated with the requested individuals.For example, as illustrated, the phenotypical data 804 may associate thenames included in the request (e.g., Alice and Bob), with randomizedidentifiers (e.g., 1234 and 5678) associated with their correspondinggenomic data. In certain embodiments, the first program 802 may beassociated with a first processing domain (e.g., a first computer systemand/or the like) that does not store and/or otherwise have direct accessto genomic data associated with the genomic data identificationinformation. Accordingly, if the security of the first processing domainis compromised, an attacker may not access genomic data associated withan individual based solely on knowledge of the phenotypicalidentification information associated with the user (e.g., a name or thelike). In some embodiments, the first program 802 may not provide thegenomic data identification information to the genetic counselingservice 800, thereby preserving the anonymity of the genomic dataidentification information.

After identifying genomic data identification information associatedwith the requested individuals, the first program 802 may send thegenomic data identification information to one or more second programs806, 808. For example, as illustrated, genomic data identificationinformation associated with Alice, 1234, may be sent to second program806, and genomic data identification information associated with Bob,5678, may be sent to second program 808.

Based on the genomic data identification information, the secondprograms 806, 808, may retrieve corresponding genomic data 812, 814 froma genomic database 810. The second programs 806, 808 may have access toone or more genomic databases 810 associating genomic dataidentification information of an individual with genomic data of theindividual. For example, second program 806 may use genomic dataidentification information associated with Alice to retrieve genomicdata associated with Alice 812 from the genomic database 810. Similarly,second program 808 may use genomic data identification associated withBob to retrieve genomic data associated with Bob 814 from the genomicdatabase 810.

The second programs 806, 808, may be configured to analyze the retrievedgenomic data 812, 814 to determine whether the genomic data 812, 814exhibits a particular variant indicative of carrier status. The secondprograms 806, 808 may send the results of this determination to a thirdprogram 816. In certain embodiments, the results may not includeidentification information associated with individuals. For example, theresults may indicate a binary carrier status (e.g., “Carrier” or “Not aCarrier”) without including any information regarding an individualassociated with the carrier status. In this manner, the results may notbe used to associate a carrier status with a particular individual.

The third program 816 may indicate, based on the carrier resultsgenerated by the second programs 806, 808, whether the results indicatethat both individuals are carriers, and thus at an elevated risk ofhaving offspring with a disease of interest. The third program 816 maysend this result to the genetic counseling service 800. In someembodiments, this result may be a binary result indicating whether bothindividuals are carriers of a variant of interest (e.g., “Yes” or “No”).In this manner, in response to the initial request issued by the geneticcounseling service 800 regarding whether both individuals are carriers,the counseling service 800 may receive a binary affirmative or negativeresponse. Accordingly, individual carrier status is only reveled to thegenetic counseling service 800 in the case that both individuals arecarriers, which may be exceedingly rare. For example, the probability isapproximately 0.14% even in the most at-risk population for Tay-SachsDisease, and thus, in this example, the probability is small thatprivate information associated with the individuals would be revealed bythe illustrated process.

In certain embodiments, the first program 802, the second programs 806,808, and/or the third program 816 may be executed in a single processingdomain and/or execution environment and/or plurality of processingdomains and/or execution environments. In certain embodiments, executingthe first program 802, the second programs 806, 808, and the thirdprogram 816 in a plurality of different domains and/or executionenvironments may help to maintain the security of personal informationand/or genomic data in the event one or more of the domains and/orexecution environments is compromised. For example, if a processingdomain of the third program is compromised, an attacker may accessinformation regarding the carrier status of two unknown individuals, butmay not access PII information associating the carrier status with thetwo particular individuals. In this manner, in some embodiments, theprocessing domains may provide for an execution environment that mayexecute programs that analyze genomic data without revealing anunacceptable amount of intermediate information to a creator of the dataanalyzing program or a service using the same (e.g., a geneticcounseling service 800).

Memoization Overview

Many conventional bioinformatics routines may not be particularlyoptimized to run across large data sets and/or on parallelized hardwareand/or software domains and/or execution environments. For example,variant identification programs, such as the GATK program available fromthe Broad Institute, may be used to identify features of interest ingenomic data. FIG. 9 illustrates a conceptual diagram 900 of a variantidentification program consistent with embodiments disclosed herein.

As illustrated, a variant identification program may be configured toreceive one or more binary genome sequence files (e.g., .bam files). Thevariant identification program may produce a file (e.g., a .vcf file)containing identified variants for the genomic data included in thereceived binary genome sequence files. For example, a variant callingalgorithm 902 of a variant identification program may be used toidentify variants included in genome data associated with the receivedbinary genome sequence files. As part of this process, the variantcalling algorithm 902 may produce and/or use various statistics and/orstate information 904 associated with the variant calling process.

In certain circumstances, the accuracy of the variant identificationprocess may depend upon a number of genomes input into the variantidentification program. For example, a larger number of genomes inputmay yield a more accurate set of variant calls and/or identifications(e.g., by building a body of relevant statistics and/or stateinformation 904 associated with the variant calling process). In someembodiments, the variant identification process may be batch-oriented.Accordingly, achieving a high degree of variant identification accuracyon a single genome may involve providing a much larger reference set ofgenomes to the variant calling algorithm 902.

The larger reference set may be used internally by the program tocompute various statistics and/or state information 904 that enablesmore accurate variant calling by the variant calling algorithm 902.Consistent with embodiments disclosed herein, a memoization process maybe used to enable results of certain computations based on genomic datato be retained and used in connection with future computations. Forexample, through a memoization process, intermediate statistics and/orstate information 904 may be stored persistently for reuse in connectionwith future runs of the variant calling algorithm 902, thereby saving alarge amount of future re-computation and accelerating the variantidentification process. In certain embodiments, the memoization processmay separate variant analysis functions of a variant identificationprogram from associated computation states. The variant analysisfunctions may include the algorithms for computing variant calls, andthe computation states may maintain a state of the computations onpersistent storage.

Some computation nodes or modules may be referentially transparent—thatis, they may produce the same output deterministically in response tothe same input. For example, to implement a memoization process, thecomputation unit may not use internal randomization or fetch parametersfrom other input devices, and all input parameters may be known beforethe computation is started. Based on this behavior, intermediate resultsmay be cached in persistent storage and used in connection with futurecomputations. In certain embodiments, to signal that a function isreferentially transparent, a specification file may use an appropriatekeyword (e.g., “memo” or the like) before a “type” specification, asillustrated in the specification file 1000 illustrated in FIG. 10.

In the illustrated specification 1000, correspondence between the inputsand outputs of the “genoselect” instance in the “ABCInstitute” domainmay be persistently stored. As a result, a downstream function thatdepends on a particular computed value may receive the value relativelyquickly because the computation may be avoided if its results have beenpreviously cached. In some embodiments, the memoization process maydepend on persistently storing a correspondence between inputs andoutputs of an associated process. In certain embodiments, if the codefor the function is opaque, the disclosed memoization process may treatthe function as black box. In other embodiments, some or all partialcomputation results may be persistently stored for future use.

In certain embodiments, a result may be analyzed to determine if itshould be stored in persistent storage or if it should be recalculatedin connection with future computations. In some embodiments, thisdetermination may depend on a variety of factors including, withoutlimitation, an amount of available persistent storage, the cost of thestorage, the cost of moving output data from the storage versusre-computation, and/or the like. In certain embodiments, memoizationprocesses may be integrated in a manner that allows a user to usepreviously-computed results from another user if such reuse is allowedby associated access policies.

In certain embodiments, to avoid persistently storing all possible inputvalues in connection with a memoization process and to facilitate fasterlookup, the input values may be stored as cryptographic hashes,signatures, or other values, which may then be used to look up apreviously computed output. In certain embodiments, cryptographichashing may further be performed on instructions associated with acomputation. In some embodiments, a table may be used to store persistedinput and/or output combinations and/or hashes thereof for use inconnection with future computations.

FIG. 11 illustrates a conceptual diagram 1100 of a computation havingtwo inputs and one output consistent with embodiments of the presentdisclosure. As illustrated, a computation module 1102 may receive twoinputs, “A” and “B”, and produce an output. In certain embodiments, thecomputational module 1102 may produce a deterministic output—that is,the computational module 1102 may produce the same outputdeterministically in response to the same input.

FIG. 12 illustrates a conceptual diagram 1200 of a computation includinga memoization module 1202 consistent with embodiments of the presentdisclosure. As illustrated, the computation has two inputs, “A” and “B”,and one output. In one embodiment, to implement a memoization process,the inputs may be provided to a memoization module 1202. The inputs mayfurther be provided by the memoization module 1202 to the computationalmodule 1102 that may produce an output based on the same. The output maybe provided to the memoization module 1202 for storage as well as beingoutput from the computation. In this manner, the memoization module 1202may persistently store the inputs and their associated outputs. Incertain embodiments, computed hashes or some other identification of thereceived inputs and/or outputs (sometimes referred to herein as asignature of the computation) may be persistently stored by thememoization module 1202 to facilitate subsequent lookup and retrieval.

In connection with subsequent computations, the memoization module 1202may generate a hash or other identifier based on the received inputsand/or instructions associated with the computation. The memoizationmodule 1202 may compare this hash or other identifier to a table ofknown values and computation results. If no match is found, thecomputation may proceed by providing the received inputs to thecomputation module 1102 to compute an output as described above. If amatch is found, the memoization module 1202 may provide the associatedoutput as an output for the computation without having to re-compute theoutput based on the received inputs. It will be appreciated that while,for purposes of illustration, hash values are used in this and otherexamples as a look-up mechanism, any suitable look-up mechanism(s) couldbe used to identify and retrieve the results of previous computations.It will also be appreciated that the memorization process describedherein could be implemented in any suitable manner, and that theexamples shown in FIGS. 12-16 are provided for purposes of illustration,and not limitation. For example, in some embodiments, the processillustrated in FIG. 12 could be implemented by, e.g., simply insertingcode into the program illustrated in FIG. 11 to check, prior toperforming a computation, whether the computation has been previouslyperformed (and the results stored), and, if so, retrieving and using (orreturning) that result, and, if not, performing the computation andstoring the result for future use.

Memoization and Multi-Node Computations

FIG. 13 illustrates a conceptual diagram 1300 of a computation includinga plurality of constituent computations implementing memoizationprocesses consistent with embodiments of the present disclosure.Particularly, the illustrated computation may receive two inputs, “A”and “B”, to produce an output. In connection with the producing theoutput, the illustrated computation may use two computational modules1302, 1304 configured to perform constituent steps of the computation.For example, a first computation module 1302 may be configured toproduce an output based on the received inputs, “A” and “B”, and providethis output to a second computational module 1304 as an input for use inconnection with generating an output of the overall computation.

To implement a memoization process, the inputs, “A” and “B”, may beprovided to the first memoization module 1306 prior to being provided toand/or in additional to the first computational module 1302. The firstcomputational module 1302 may produce an output based on the receivedinputs, and may provide the generated output to the first memoizationmodule 1306. The first memoization module 1306 may persistently storethe inputs and the output from the first computational module 1302 foruse in connection with future computations. As discussed above, in someembodiments, hash values of the received inputs, instructions associatedwith the computation, and/or the output of the first computationalmodule 1302 may be persistently stored by the first memoization module1306.

The output from the first computational module 1302 may be provided(e.g., by the first memoization module 1306) as an input to the secondmemoization module 1308 prior to being provided to and/or in additionalto the second computational module 1304. The second computational module1304 may generate an output based on the input (and possibly otherinputs, not shown) and provide the output to the second memoizationmodule 1308. The second memoization module 1308 may persistently storethe input and the output from the second computational module 1302 foruse in connection with future computations. In some embodiments, hashvalues of the received inputs, instructions associated with thecomputation, and/or the deterministic output of the second computationalmodule 1304 may be persistently stored by the second memoization module1308.

The exemplary computation illustrated in FIG. 13 integrates memoizationprocesses in connection with constituent computational steps of amulti-step computation. In further embodiments, in lieu of or inaddition to integrating memoization in connection with constituentcomputational steps, an overall computational output of a multi-stepcomputation may be used in connection with a memoization processes. Forexample, in certain instances, information stored as part of amemoization process involving constituent steps of a computation may notbe likely to be used in connection with future computations.Accordingly, storing output from constituent steps using the disclosedmemoization processes may not be necessary.

FIG. 14 illustrates another conceptual diagram 1400 of a computationincluding a plurality of constituent computations implementingmemoization processes consistent with embodiments of the presentdisclosure. As illustrated, the computation may use first and secondcomputational modules 1402, 1404, to perform steps of a multi-stepcomputational process. Consistent with embodiments disclosed herein, asingle memoization module 1406 may be used to persistently store inputs,instructions associated with the computation, and/or generated outputsand/or information relating to the same (e.g., hashed values or thelike) of the overall computational process. Such a memoizationimplementation may be used in computational situations where informationrelating to constituent process steps may not be of particular interestin connection with future computations.

Memoization in Bioinformatics Computations

In some embodiments, memoization techniques may be used in connectionwith various bioinformatics computations, including, for example,genomic data computations such as those described herein. In certainembodiments, all and/or part of information persistently stored as partof a memoization process may reside locally under the control of anassociated memoization module and/or may be associated with a remotemodule and/or computing system that other systems executingcomputational processes may access.

Information persistently stored as part of a memoization process may bemanaged in any suitable manner. For example, cost/benefit calculationsand/or heuristic algorithms can be used to determine the efficacy ofstoring certain information. For example, persistent storage ofinformation that is commonly and/or recently used in connection with acomputation may be prioritized over storage of information that is notcommonly used and/or has not been recently used (e.g., prioritized inconnection with efficient lookup operations, deletion activities in theevent of limited storage space, and/or the like). In certainembodiments, persistently stored information may be managed in a mannersuch that looking-up relevant information in connection with futurecomputations takes less time and/or is otherwise more efficient thanperforming the computation again.

In certain circumstances, genomic data may be relatively similar betweenindividuals. For example, genetic similarity between two humanindividuals may be higher than 99.9%. Genetic similarity between humansand yeast may be approximately 50%. Given the inherent similarity ingenomic data, certain computations performed in connection with genomicdata may often be repeated in connection with later computations. Forexample, a computation performed on a portion of genomic data may likelyhave already been performed in connection with prior researchinvestigations. Accordingly, memoization processes may be used tolook-up outputs associated with the prior computations (e.g., geneticvariant identification and/or disease risk computations, etc.), therebysaving computational time and/or resources in connection with requestsfor certain later computations. In some embodiments, a service (e.g., aweb service) can be provided to facilitate the lookup and retrieval ofthe results of computations. Requests to the service can specify inputs,and a lookup can be performed to see if the service has access to acorresponding output. In some embodiments, the outputs could be storedin a central repository, while in other embodiments the results could bedistributed amongst multiple repositories or other locations. In someembodiments, the service might return the result of the computation tothe caller of the service, and in other embodiments, the service mightsimply redirect the caller to a location where the result could beobtained.

Policy-Driven Memoization Processes

In certain embodiments, memoization nodes and/or modules in acomputational process may be policy-driven. For example, in certainjurisdictions, legal requirements may not allow genomic data within thejurisdiction to be accessed from outside the jurisdiction.Jurisdictional requirements may further stipulate that genomic data mayonly be operated on within the jurisdiction by some trusted authority.

To accommodate such jurisdictional requirements, a computational modulemay be located in a jurisdiction and/or domain different from thejurisdiction and/or domain of an associated memoization module. Forexample, if allowed by associated policy, a computational module mayoperate within a jurisdiction restricting the access of associatedgenomic data from outside the jurisdiction, while a memoization moduleassociated with the computational module may operate outside thejurisdiction. In this manner, the computational module may comply withthe jurisdiction's requirements, but results of associated computationspersistently stored by the memoization module may be readily accessedoutside the jurisdiction for use in connection with future computations.

In addition to persistently storing information regarding inputs to acomputation, corresponding outputs, and/or hashes or other identifiersthereof, in some embodiments, other parameters may be persistentlystored as part of a memoization process. For example, credentialinformation and/or policy information provided as part of apolicy-managed computation may be stored as inputs by a memoizationmodule for use in connection with future computations. Like thecomputation inputs and/or outputs, in some embodiments, hashes of thecredential information and/or policy information may be persistentlystored to increase look-up efficiency and/or integrity verification inconnection with future computations.

FIG. 15 illustrates a conceptual diagram 1500 of a computationimplementing policy-driven memoization processes consistent withembodiments of the present disclosure. As illustrated, variousinformation may be provided to a policy enforcement module 1506 inconnection with a computation including, without limitation, inputs(e.g., “A” and “B”), credentials 1508 (e.g., credentials of a userrequesting the computation be performed), and/or policy information 1510associated with the user, the computation, and/or the inputs. Based onthe received inputs, the policy enforcement module 1506 may determinewhether the requested computation is allowed by policy and can proceed.

If the computation is allowed to proceed, the inputs, “A” and “B”, maybe provided to a computation module 1502 associate with a memoizationmodule 1504 operating in the manner discussed above. For example, thememoization module 1504 may, based on the received inputs, determine ifan output for the associated inputs has been previously computed and isavailable in persistent storage. If the previously computed output isavailable, the memoization module 1504 may provide this output as anoutput for the computation. If the previously computed output is notavailable, the computation module 1502 may perform the computation. Theoutput of the computation module 1502 may be provided to the memoizationmodule 1504 for persistent storage and use in connection with futurecomputations.

FIG. 16 illustrates a conceptual diagram 1600 of another policy-drivenmemoization processes consistent with some embodiments of the presentdisclosure. As discussed above, in certain embodiments, credentialinformation and/or policy information and/or hashes thereof may bepersistently stored to increase look-up efficiency in connection withfuture computations, in addition to computation inputs, outputs, and/orhashes thereof. Accordingly, in the illustrated example process, thecredentials 1508 and policy information 1510 may be provided to amemoization module 1504 in addition to the computation inputs, and/oroutputs. Accordingly, in future computations, when the same inputs,credentials 1508, and/or policy information 1510 are provided, anassociated persistently stored output may be accessed by the memoizationmodule 1504 and provided as a computational output.

FIG. 17 illustrates an exemplary system 1700 that may be used toimplement embodiments of the systems and methods disclosed herein. Theexemplary system 1700 may comprise a computer system or other devicethat may perform the operations disclosed herein. For example, system1700 might comprise a personal computer, a server system, a mobiledevice (e.g., a smartphone, a tablet, etc.), and/or the like. Asillustrated in FIG. 17, the system 1700 may include, for example: aprocessing unit 1702; system memory 1704, which may include somecombination of high speed random access memory (“RAM”), non-volatilememory (“ROM”), and/or one or more bulk non-volatile computer-readablestorage mediums (e.g., a hard disk, flash memory, etc.) for storingprograms and other data for use and execution by the processing unit1702; a port 1706 for interfacing with removable memory 1708 that mayinclude one or more diskettes, optical storage mediums (e.g., flashmemory, thumb drives, USB dongles, compact discs, DVDs, etc.) and/orother computer-readable storage mediums; a network interface 1710 forcommunicating with other systems via one or more networks 102 using oneor more communication technologies; a user interface 1716 that mayinclude a display and/or one or more input/output devices such as, forexample, a touchscreen, a keyboard, a mouse, a track pad, and/or thelike; and one or more busses 1730 for communicatively coupling theelements of the system 1700.

In some embodiments, the system 1700 may, alternatively or in addition,include an SPU 1714 that is protected from tampering by a user of system1700 or other entities by utilizing physical and/or virtual securitytechniques. An SPU 1714 can help enhance the security of sensitiveoperations such as trusted credential and/or key management, securegenomic data management, and other aspects of the systems and methodsdisclosed herein. In certain embodiments, the SPU 1714 may operate in alogically secure processing domain and be configured to protect andoperate on secret information. In some embodiments, the SPU 1714 mayinclude internal memory storing executable instructions or programsconfigured to enable to the SPU 1714 to perform secure operations. Forexample, in some embodiments an SPU 1714 such as described incommonly-assigned U.S. Pat. No. 7,430,585 (“the '585 patent”) and/orU.S. Pat. No. 5,892,900 (“the '900 patent”) could be used.

The operation of the system 1700 may be generally controlled by aprocessing unit 1702 and/or a SPU 1714 operating by executing softwareinstructions and programs stored in the system memory 1704 (and/or othernon-transitory computer-readable media, such as removable memory 1708).The system memory 1704 may store a variety of programs or modules forcontrolling the operation of the system 1700. For example, the systemmemory 1704 may include an operating system (“OS”) 1718 that may manageand coordinate, at least in part, system hardware resources and providefor common services for execution of various applications, and a policymanagement module 1720 configured to manage and/or enforce policyassociated with genomic and/or other bioinformatic data. The systemmemory 1704 may further include, without limitation, communicationsoftware 1722 configured to enable in part communication within and bythe system 1700, computations 1724 (e.g., computations configured tooperate on genomic data or the like), a memoization module 1726configured to implement memoization processes in connection withcomputations 1724 consistent with embodiments disclosed herein, and/orlocally stored genomic data 1728.

The systems and methods disclosed herein are not inherently related toany particular computer, electronic control unit, or other apparatus andmay be implemented by a suitable combination of hardware, software,and/or firmware. Software implementations may include one or morecomputer programs comprising code/instructions that, when executed by aprocessor, may cause the system to perform a method defined at least inpart by the program instructions. The computer program can be written inany form of programming language, including compiled or interpretedlanguages, and can be deployed in any form, including as a standaloneprogram or as a module, component, subroutine, or other unit suitablefor use in a computing environment. Further, a computer program can bedeployed to be executed on one computer or on multiple computers at onesite or distributed across multiple sites and interconnected by acommunication network. Software embodiments may be implemented as acomputer program product that comprises a non-transitory storage mediumconfigured to store computer programs and instructions, that whenexecuted by a processor, are configured to cause a computer system toperform a method according to the instructions. In certain embodiments,the non-transitory storage medium may take any form capable of storingprocessor-readable instructions on a non-transitory storage medium. Anon-transitory storage medium may be embodied by a compact disk,digital-video disk, a magnetic tape, a magnetic disk, flash memory,integrated circuits, or any other non-transitory memory device.

Although the foregoing has been described in some detail for purposes ofclarity, it will be apparent that certain changes and modifications maybe made without departing from the principles thereof. It should benoted that there are many alternative ways of implementing both thesystems and methods described herein. Accordingly, the presentembodiments are to be considered as illustrative and not restrictive,and the invention is not to be limited to the details given herein, butmay be modified within the scope and equivalents of the appended claims.

1-12. (canceled)
 13. A method for performing trusted computations ongenomic data performed by a distributed computing system comprising aprocessor and a non-transitory computer-readable storage medium storinginstructions that, when executed by the processor, cause the system toperform the method, the method comprising: receiving first policyinformation from a stakeholder system articulating one or more firstrequirements associated with computational results generated using agenomic data set; receiving a first request from a user system toperform a computation by the distributing computer system, the firstrequest comprising a first set of one or more pieces of identificationinformation, the computation comprising analyzing a genomic data set todetermine a particular genomic feature of the genomic data set;determining, based on the first set of one or more pieces ofidentification information, that a result of a prior computation usingthe first set of one or more pieces of identification information is notstored in a persistent storage associated with the distributed computingsystem; storing information associated with the first set of one or morepieces of identification information in the persistent storage;generating, based on the first set of one or more pieces ofidentification information, a result of the computation using thegenomic data set; securely associating the result of the computationwith the first policy information; storing the result of the computationand the securely associated first policy information in the persistentstorage; and sending the result of the computation to the user system.14. The method of claim 13, wherein the method further comprises:receiving a second request to perform the computation by thecomputational module using the genomic data set, the second requestcomprising the first set of one or more pieces of identificationinformation; determining, based on the first set of one or more piecesof identification information, that the result of the computation isstored in the persistent storage; accessing the result of thecomputation from the persistent storage; determining, based on the firstpolicy information securely associated with the result of thecomputation, whether the result of the computation may be sent to asystem associated with the second request.
 15. The method of claim 14,wherein determining whether the result of the computation may be sent tothe system associated with the second request comprises determining thatthe first policy information permits sending the result of thecomputation to the system associated with the second request and themethod further comprises sending the result of the computation to thesystem associated with the second request.
 16. The method of claim 14,wherein determining whether the result of the computation may be sent tothe system associated with the second request comprises determining thatthe first policy information not does permit sending the result of thecomputation to the system associated with the second request and themethod further comprises preventing the result of the computation frombeing sent to the system associated with the second request.
 17. Themethod of claim 13, wherein the method further comprises receiving, fromthe stakeholder system, the genomic data set.
 18. The method of claim13, wherein the method further comprises receiving second policyinformation securely associated with the genomic data set articulatingone or more second requirements associated with the use of the genomicdata set.
 19. The method of claim 18, wherein generating a result of thecomputation using the genomic dataset comprises determining that the oneor more second requirements articulated by the second policy informationhave been met.
 20. The method of claim 18, wherein the second policyinformation is received from the stakeholder system.
 21. The method ofclaim 13, wherein the first set of one or more pieces of identificationinformation comprises authentication information.
 22. The method ofclaim 13, wherein the first set of one or more pieces of identificationinformation comprises a cohort selection associated with the genomicdata set.
 23. The method of claim 13, wherein the first set of one ormore pieces of identification information comprises instructioninformation associated with the computation.
 24. The method of claim 13,wherein the method further comprises associating the informationassociated with the first set of one or more pieces of identificationinformation with the result of the computation in the persistentstorage.
 25. The method of claim 13, wherein the information associatedwith the first set of one or more pieces of identification informationcomprises a computed hash of the first set of one or more pieces ofidentification information.
 26. The method of claim 13, wherein theinformation associated with the first set of one or more pieces ofidentification information comprises the first set of one or more piecesof identification information.
 27. The method of claim 13, wherein thegenomic data set comprises human genomic data.
 28. The method of claim13, wherein determining that the result of a prior computation is notstored in the persistent storage comprises: computing a hash of thefirst set of one or more pieces of identification information;determining that the hash of the first set of one or more pieces ofidentification is not stored in the persistent storage; and based on thedetermination, determining that the result of the prior computation isnot stored in the persistent storage.